Integrating prosodic modelling with incremental speech recognition

We describe ongoing and proposed work concerning incremental prosody extraction and classification for a spoken dialogue system. The system described will be tightly integrated with the SDS’s speech recogntion which also works incrementally. The proposed architecture should allow for more control over the user interaction experience, for example allowing more precise and timely end-ofutterance vs. hesitation distinction, and auditive or visual back-channel generation.